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ABSTRACT 

In 1987, General Educational Development (GED) test 
passing score requirements were raised in Wisconsin. To study the 
effect, data were gathered from samples of 4P0 examinees each for 
1986 and 1989 through site visits and follow-up surveys mailed to 900 
of the 960 in the samples. Responses were received from 206 persons 
(37 percent). Chi-square and t-tests were used to analyze thG data, 
yielding such findings as the following: (1) no effects on the 
demographic and academic composition of examinees were found; (2) the 
1989 examinees significantly increased their academic preparation 
efforts; (3) significantly higher percentages of 1989 examinees 
failed to obtain minimum and average scores required for passing; (4) 
1989 examinees were significantly more likely to enroll in further 
education or training programs; (5) 1989 examinees had significantly 
lower incomes and were more likely to be unemployed than 1986 
examinees, but 1989 examinees who passed the GED tests were 
significantly more likely to be employed than le who failed; (6) 
with each increase in the minimum score requii there were 

correspondingly greater increases in the varianuc .etween the lowest 
and highest scores on the five tests but only small increases for the 
norming sample. The study recommended keeping the new higher minimum 
score requirement but lowering the five-test average score for 
passing; further study of the GED tests was suggested. (The survey 
instrument with cover letLer is appended.) (KC) 
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Executive Summaiy 



I. Problem Statement 

A. In 1987 the DPI increased the score requirements for obtaining a GED diploma. 
The new standards require examinees to obtain a minimum score of 40 on any 
single test and an average of SO for all tests-for a total score of 250 on all tests. 

B. Since the new score requirements were implemented, there has been a sharp 
decrease in the numbers of GED credentials issued in Wisconsin, e.g., there was 
a 68.6 percent decrease between 1987 and 1989. 

C. There are considerable disagreements among DPI administrators, adult literacy 
administrators, and adult literacy practitioners about the need for and effects of 
the new score requirements. 



II. Research Questions 

A. To what extent did the new GED requirements in Wisconsin effect the 
demographic and academic characteristics of the examinees in 1989 who took 
the tests? 

B. To what extent did the new GED score requirements in Wisconsin effect the 
1989 examinees' perceptions toward preparatory programs and the m<».thods they 
used to prepare for the tests? 

C. To what extent did the new GED score requirements in Wisconsin effect the 
number of examinees in 1989 who obtained a passing or failing score? 

D. To what extent did the nevv GED score requirements effect the number of 
examinees who failed to complete all five tests in 1989? 

E. To what extent did the new GED score requirements effect the degree to which 
those who passed the GED tests in 1989 perceived it as being personally 
beneficial, e.g., helpful in attaining educationally related goals, and to obtain 
either education or training? 

F. To what extent has either passing or failing the GED tests had an effect on the 
ability of 1989 examinees to acquire employment, increase personal income, or 
change the source of personal income? 



G. What would be the differential rates of passing for the 1986 and 1989 GED 
examinees and the 1987 Norming Sample given the different formulas currently 
being utilized by different states to establish score requirements? 

H. What would be the differential rates of passing for the 1986 and 1989 GED 
examinees and the 1987 Norming Sample given the four Minimum Scores 
currently recognized by the American Council on Education? 



III. Findings and Conclusion 

A. No Effects on the Demographic and Academic Composition of Examinees-there 
were no relevant significant changes in the demographic and academic 
characteristics of the examinees from 1986 to 1989. 

B. Increased Academic Preparation and Performance-the 1989 examinees 
significantly increased their academic preparation efforts in order to attain 
higher minimum and average scores. These efforts apparently resulted in the 
statistically significant increases in academic performances observed for 1989 
examinees compared to those in 1986. 

C. Increased Academic Failure-significantly higher percentages of 1989 examinees 
failed to obtain minimum and average scores required for passing, even after 
one or more retests. 

D. A Disincentive to Complete the Tests-Analysis of t-test comparisons to test 
scores for 1986 and 1989 noncompleters, and comparisons of noncompieters 
from both years to their counterparts who completed all five tests suggest that 
1989 noncompleters may have discontinued their examinations for "academic" 
reasons. 

E. Increased Participation in Postsecondary Education or Trnining"1989 
examinees were significantly more likely to enroll in educational or training 
programs and to indicate the GED was helpful for this purpose. 

F. Reduced Economic Benents-1989 examinees earned significantly lower incomes 
and were significantly more likely to be unemployed than 1986 examinees. 
However, those 1989 examinees who passed the GED tests were significantly 
more likely than those who failed to be employed either full or part-time. 

G. Increased Score DifTerentintion With increases in Minimum Scores-with each 
increase in the minimum score requirement, there were correspondingly greater 
increases in the variances between the lowest and highest scores on the five tests 
among the GED examinees, but only small increases for the Norming Sample. 



III. Recommendations 



A. The score requirement should be changed from a "minimum of 40 and an 
average of 50" to a minimum of 40 and an average of 45. This requirement 
would maintain the higher minimum scores of the present requirements, thereby 
demanding higher knowledge of examinees on all tests. However, it would lower 
the required average scores thereby permitu'ng greater access to the GED. 

B. The results of the 1987 Norming Study should be disregarded as invalid and a 
new more representative study should be conducted. 

C. The administrators of GED test storage sites should adopt a conunon (uniform) 
set of data collection, storage and retrieval procedures. 

D. The process useo establish score requirements for the GED tests should be 
evaluated. 

E. Further research should be conducted to address other significant questions and 
issues raised by this study. 
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FINAL REPORT 

Assessment of the 1987 Changes in GED Score Requirements in Wisconsin 
INTRODUCTION 

Prior to 1987, the state of Wisconsin required examinees seeking a General Education Development 
(GED) diploma to obtain a minimum score of 35 on any single test and a average of at least 45 Tor all five 
tests (for a total score of 225 on all tests). In 1987, the rule under which the Wisconsin Department of Public 
Instruction (DPI) issued the high school equivalency diplomas was changed. One clement of the new rule 
(PI5, Wis. Admin. Code) increased the age requirement for GED examinees to 18.6 years of age. Another 
clement authorized the DPI to issue two kinds of credentials: a certificate of General Educational 
Development (GED) and a high school equivalency diploma (HSED). 

A certificate of GED indicates that an individual has completed a major part of the work required to 
cam a high school equivalency diploma, but not all of it. A HSED challenges the examinee to meet several 
other requirements and is considered by the DPI to be the best substitute for a regular high school diploma. 
It requires examinees to: 1) meet p'^.w score requirements; 2) either complete 0.5 high school credits, 
successfully complete an approved course, or receive a passing score on a DPI approved test in health; 3) 
either successfully complete a course, obtain 3 high school credits, or receive a passing .score on a DPI 
approved test in citizenship; 4) provide written verification of the attainment of employability skills; and 5) 
provide written verification of instruction in career awareness. 

The new score requirements, which were phased in during the 19iS8 calendar year arc applicable to both 
types of certifications. They require examinees to obtain a minimum score of 40 on any single Icsinnd an 

average of at least 50 for all tests-for a total score of 250 on all tests (DPI Bulletin No. 9017, 19S8). The 
new Wisconsin completion standards are the highest in ihc nation. While the minimum requirements are f«et 
nationally so that 25 percent of graduating high school seniors could not pass the tests, Wisconsin's standards 
are such that 51 percent of high school seniors nationally could not meet the requirements (19S9 (iCD 
Statistical Report), while 34.4 percent of Wisconsin\s seniors, and 58 percent of the stalc\s African American 
seniors would fait the requiremems (The Wis. Norming Study, 1988). 
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Reasons for the New Score Requirements 

The State Superintendent cited several reasons for changing the score requirements. First, he identified 
two statutory provisions which indicated a need for changes: [s. 115.29(4)], Wis. Stats., indicates that the 
alternative diploma the Superintendent is empowered to award is to be "equivalent** to a high school diploma; 
and the educational standards enacted by the legislature in 1988 added several requirements for high school 
graduation, e.g., instruction in health, civics, and job-seeking and retention skills (WLAB Report, 1991). 

Second, several circumstances were cited which prompted the change: a) a concern that some high 
school students were dropping out of school believing they could quickly and easily obtain a GED diploma 
without having to complete regular school class work, b) results of a 1986 UW-Milwaukee Employment and 
Training Institute survey of employers' attitudes concerning GED diplomas that indicated employers did not 
fmd the GED diploma credible as a substitute for a high school diploma when making hiring decisions, and 
c) data from the UW-Milwaukee study which indicated that GED recipients who enrolled in college had 
higher dropout rates and lower grade point averages (han high school graduates (WLAB Report, 1991). 

The Basis of the Nevy Score Requirements 

The new score requirements were based on a 1987 norming study that was conducted statewide. The 
study sampled SO schools and included a total of 1,112 students who took one or more tests. Complete data 
was available for 913 students. However, both the male/female proportions (45/55%) and the hiack/whitc 
proportions (2/95%) of the students were sufficiently different from state, proportions (50/50 and 8/87% 
respectively) that the sample could not be considered to be truly representative of Wisconsin seniors 
(Wisconsin Norming Study, 1988). The study also noted that the nineteen black students who took all five 
tests averaged approximately 7.0 scale score points lower than the white students. However, DPI ofTicials 
argued that due to the nonparticipation of key schools with high concentrations of black students the students 
in the sample known to be black were most likely not representative of black Wisconsin high school seniors. 
Therefore, they recommended against weighing the scores of black students in the sample, arguing that it 
would only introduce another unknown bias into the sample data. Additionally, they argued that there is no 
need to adjust the scores to compensate for the overrepresentation of females in the study because ihc 
difference between the average scores for males and females was negligible (males averaged 52.5 and females 
averaged 52.9). 



These unadjusted summary data were interpreted by the State Superintendent to indtcalc that 
Wisconsin students scored significantly higher than a national sample of graduating seniors and (hat the 
minimum passing standards in Wisconsin needed adjustments (The Wis. Norming Study, 1988). * said, "the 
new rules are intended to encourage students to remain in school while providing adults with sever / r prions 
to earn an equivalency diploma that more appropriately reflects the requirements of the state's high school 
graduation standards and education for employment initiative" (The Wis. Norming Study, 1988). 

STATEMENT OF THE PROBLEM 

The GED program is the largest and most successful dropout recovery program tn Wisconsin. Over an 
eighteen year period, from 1971 to 1989, 125,717 GED credentials were issued in the state (The GED 
Statistical Report, 1989). During the three years (1984 through 1986) prior to the 1987 changes in rules md 
score requirements, an average of 8,137 credentials were issued in the state (The GED Statistical Report, 
1986). During the two years following the implerr:sntation of the rule changes and new score rcquircmcnis^ 
the number of credentials awarded in the state dropped from 4,603 credentials issued in 1988 lo 2,660 issued 
in 1989. Although nationally a more rigorous GED test was also phased in during this lime period, the 42 
percent decrease compares to a national decrease of 13.4 percent and an increase in our neighboring state of 
Illinois of 9.9 percent. Also, comparing the number of GED credentials earned in 1989 to those earned in 
1987 (the last full year that allowed GED completion under Wisconsin's old standards), the number of GED 
completions dropped from 8,468 lo 2,660; a 68.6 percent decrease. During this same period, the national 
decrease was 20.4 percent and the decrease for the neighboring state of Illinois was 0.7 percent (The 1989 
GED Statistical Report). 

The sharp decrease in GED diplomas prompted an investigation by the Wisconsin Legislaiive Audit 
Bureau. The WLAB conducted extensive interviews with personnel who have loeail, siaie, and national 
afniiation with the GED. In its report, the WLAB (1991) found logical inconsislencies In DPI's aigunicnis 
supporting the higher standards, and considerable disenchantment with and concern about the ciTccts of the 
increased score requirements among Wisconsin program administrators and praictitioners. WLAB (1991) 
found that opponents of the increased score requirements discount the circumstances cited as prompting the 
additional requirements. They argued that the goals of the individuals seeking alternative diplcmias should l>c 
considered. Since many GED program participants are interested in improving their employment 
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opportunities or tn achieving the self*esteem which results from completiag the diploma, they argued that no 
barriers beyond those which are absolutely necessary to maintain credibility should be established. 

The WLABi (1991) report also made several other observations. First, no studies verified the 
assumption that the availability of the GED diploma was influencing dropouts. This concern seems to 
contradict a new rule, implemented in July 1991, which allows students who are 17 years old and are at risk 
of dropping out or failing in school to participate in GED programs provided they are enrolled in high 
school. Second, the report indicated that adult literacy practitioners were not convinced that data cited by 
DPI constitute a problem, particularly since the UW-Milwaukee study also reported a majority of employers 
surveyed, 52 percent, considered the high school diploma and the GED diptoma equal. Also, 78 percent of 
the employers con^^Hered the GED diploma as acceptable as a high school diploma. Third, the 1986 UW* 
Milwaukee study presented conflicting evidence of the ability of GED grrduates to succeed in college. 
Practitioners argued that GED graduates who drop out of college may do so primarily because of family or 
flnancial difficulties, and that it is inappropriate to use college performance as evidence of a need for more 
rigorous standards since only 2 percent of GED graduates in Wisconsin enroll in four-year colleges. Fourth, 
although the UW-Milwaukcc study concluded that GED graduar'**^ enrolled in the Milwaukee Area Technical 
College had attrition rates similar to those of high school dropouts, the WLAB report points out that none of 
eight GED graduates in the highest score range of 350 to 400 graduated from MATC. Therefore it suggested 
that achieving a higher passing score did not signiflcantly increase the likelihood that a GED graduate would 
complete a MATC program. Fifth, opponents challenge tlic validity of the 1987 norming sample as being 
truly representative of graduating high school seniors in Wisconsin. They point out the significant 
underrepresentation of minorities in the sample and argue that a more representative sample might justify a 
lower standard. 

In summary, the Superintendent and other proponents of the increased score requirements are 
concerned that there is a need to ensure the awarding of a high school equivalency diploma reflects 
substantive educational achievement. Therefore, they argue that candidates for the diploma must meet 
standards that are consistent with other efforts to improve the quality ol education by raising educational 
standards, e.g., raising high school graduation requirements and university admission standards. However, 
there are considerable disagreements about the signiflcance of the research which DPI cites in support ol 
higher standards. Practitioners have also raised questions about the method DPI used to set the higher score. 
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They have argued that the higher score places too great an emphasis on the GED diploma as an equivalent 
credential to the high school diploma without adequate consideration of its role in providing access to 
increased employment and advanced educational opportunities. Although the WLAB (1991) report made 
recommendations to the DPI regarding the implementation of the new GED program requirements, it did 
not speak to the causal efTects of the changes in score requirements. 



RESEARCH QUESTIONS 

The purpose of this research is to investigate the differential effects of the changes in the 19S7 GED 
score requirements on the number of examinees completing and passing the revised GED tests in Wisconsin. 
The changes in score requirements could have triggered several reactions among those seeking (he GED, 
such as changes in: the characteristics of examinees taking ihe tests, examinees' reactions to and perceptions 
toward their preparatory programs, GED test performance, perceptions of personal benefiis from possessing 
the GED, and socioeconomic status. Therefore this study sought to address (he following research questions: 



1. To wh<nt extent did the new GED score requirements in Wisconsin effect the 
demogr<nphic and <nc<idemic characteristics of the examinees in 1989 who took 
the tests? 

2. To what extent did the new GED score requirements in Wisconsin elTect the 
1989 examinees' perceptions toward preparatory programs and the methods they 
used to prepare for the tests? 

3. To what extent did the new GED score requirements in Wisconsin efTcct the 
number of examinees in 1989 who obtained a passing or failing score? 

4. To what extent did the new GED score requirements effect the numl>cr of 
examinees who failed to complete all five tests in 1989? 

5. To what extent did the new GED score requirements '^fiVici the degree to which 
those who passed the GED in 1989 perceived it mS Urng personally l)encricial, 
e.g., helpful in attaining educ<ntionally related s. r^'j, and to obtain either 
education or training? 

6. To wh<nt e.xtent has cither passing or failing the GED tests h<nd an cn'ec! on 
the ability of 1989 examinees to acquire employment, increase personal 
income or change the source of personal income? 

7. What would be the differential rates of passing for the 1986 and 1989 GED 
examinees and the 1987 Norming Sample given the different formuLns 
currently being utilized by different ftntes to establish score requirements? 
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8« What would be the differential rates of passing for the 1986 and 1989 GED 
examinees and the 1987 Nomiing Sample given the four Minimum Scores 
currently recognized by the American Council on Education? 

BACKGROUND TO THE PROBLEM 

Nationally, the most popular alternative among adults seeking a high school diploma is the GED. 
These tests are developed by the Educational Testing Service and are administered jointly by the American 
Council on Education (ACE) and sixty-nine state, province, and territory departments and ministries in the 
U.S. and Canada (Whitney, 1983). The tests were first administered in 1942 to measure the academic skills 
of war veterans and were considered as a ''second chance** for individuals whose class had graduated from 
high school (Swarlz, et al., 1988). Over 700,000 people are tested annually in each of five subject areas: 
Writing Skills, Science, Social Studies, Interpreting Literature and the Arts, and Mathematics (Whitney and 
others, 1985). The Tests measure the "major and lasting outcomes" associated with four years of high school 
study (Baldwin, 1990). A GED diploma is awarded baseo on attainment of a minimum score on each of the 
five tests. This minimum score is typically sot at a level that exceeds the scores of from 25 to 51 percent of a 
sample of graduating high school seniors. Therefore, it is not uncommon for the standards set for GED 
examinees to be such that examinees must not only meet the standards established for graduating high school 
seniors, but they mUst exceed them. For example, a study of New York*s high school minimum competency 
test showed that 37 percent of those who passed the state*s reading competency test failed the GED Tests 
(Sonnenblick, 1980). 

There is wide variation in the specific score requirements for passing the GED because each 
participating jurisdiction sets its own specific standard. In 1989 the ACE indicated that the 50 states in the 
U.S. and the District of Columbia utilized several formulas for est<iblishing minimum score requirements: 30 
stales (58.8 percent) established a minimum score of 35 on each test and an average of 45 on all tests; 10 
states (19.61 percent) required a minimum of 40 and an average of 45; 4 states (7.84 percent) set the scores 
at a minimum of 40 or an average of 45; 2 states (3.92 percent) required a minimum of 40j)r an average of 
50; one state (1.96 percent) requires 40 on each test, and one slate requires different scores for each lest. In 
1988 Wisconsin became the (miy sinie lo require a minimum of 40 and an average of 50. The least difficult 
of these requirements is the one requiring a minimum of 40 or an average of 45; 75 percent of high school 
seniors nationally would likely meet this requirement (1989 GED Statistical Report). The most difficult 
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requirements are either •'minimum of 45", or ''minimum of 40 and an average '>f 50". Only 51 percent of U.S. 
graduating high school seniors woul^« likely meet these requirements. 

Characteristics of GED Examinees 

More than 7J million adults in the United States and Canada have obtained a GED diploma since 
1971. Approximately 450,000 examinees earn GED credentials each year. The program accounts for more 
than one of every six diplomas issued in the U.S. annually (Whitney, 1989). A 1980 survey of GED test 
candidates found that the primary reasons for taking the tests were to obtain or maintain a job (42 /7>), to 
meet admissions requirements for a college or vocational training program (30%), for personal satisfaction 
(25%), and because of military requirements (5%) (Malizio and Whitney, 1981). Although class attendance is 
not required to take the tests, 80 percent of candidates use some form of preparation and about 50 percent 
use classroom instruction (Cervero, 1983). 

While the number of GED candidates between the ages of 18 and 24 has declined nationally by 26 
percent since 1980 (Baldwin, 1990), GED examinees are still comprised of mostly young adults from a variety 
of ethnic backgrounds. In 1989 nearly a third of the GED candidates were 19 or younger and more than two- 
thirds were under 30 years of age. About 30 percent of all 1989 examinees were minorities; with II percent 
Hispanic, and 14 percent African American. More than two-thirds of the examinees completed 10th grade or 
higher before leaving school. Close to three-fourths of GED candidates reported maintaining a ''mostly C or 
belter" average while in school (Baldwin, 1990). 



Validity Of the GED 

Becau.se the GED test is normed on the performance of high school seniors, the GED Testing Service 



periodically revises them to reflect changes in the curricula and instructional practices in the nation's high 
schools. The most recent revision occurred in January 1988 when newly revised forms were administered in 
37 states. Other states and Canadian provinces followed during the remainder of the year. The 1988 revisions 
were guided by the recommendations of national advisory committees compri.scd of curriculum and adult 
education experts from throughout the country. These committees recommended two miijor changes in the 
content and format of the GED tests: the inclusion of a writing exercise, or essay, as part of the Writing 
Skills Test; and greater emphasis on higher level thinking skills in the multiple-choice portions of the tests. In 





addition, scores on the new tests reflect new norms that are based on the Spring 1987 administration of the 
tests to U.S. graduating high school seniors. 

At least two factors support (he validity of the GED Tests as a reliable and accurate measure of the 
abilities of adult examinees at the high school level nationwide: (1) the GED Tests are written and reviewed 
externally by secondary educators familiar with high school curriculum and by adult educators who arc 
intimately familiar with adults' interests and experiences (Whitney, Matizio and Patience, 1985), and (2) the 
GED Tests are standard nationwide. While the educational attainment of recipients of traditional or other 
equivalency diplomas may vary across schools or states, due to different standards, practices, and student 
experiences, a GED credential in one state or region is based on the same test battery and score scale 
nationwide (Laurence, 1983). 

Content Knowledge and Skills Measured by the GED Tests 

The test questions on the GED Tests utilize a variety of formats requiring examinees to exact 
information from excerpts of poems, plays, journal articles, newspaper articles, novels, textbooks, pic graphs, 
diagrams, word problems, maps, and simple statements (Webb, 1991). Each tes( (except for the essay section 
of the writing test) consists of multiple choice questions in a number of categories: 

Test 1: Writing Skills . Part 1 covers sentence structure, usage, and mechanics; Part 2 is an essay. 

Test 2; Social Studies . Includes questions on history, geography, economics, political science, and 

behavioral science. 

Test 3: Science . Includes life sciences (biology) and physical sciences (earth science, physics, and 
chemistry). 

Test 4: Interpreting Literature and the Arts . Includes popular literature, classical tilerulure, and 
commentary; and 

Test S: Mathematics . Includes arithmetic (measurement, number relationships, and data analy.sis) 
algebra, and geometry. 

In addition to the above areas of content knowledge, Swartz, et al., (19S8) argue that the tests are 
designed to test cognitive skills as described by Bloom's taxonomy of cognitive objectives: comprehension, 
application, analysi.s, synthesis, and evaluation. They suggest that the focus of the tests is not to simply 
regurgitate facts, but on the cognitive ability of examinees to use the most crfeetive approach to read and 



interpret a given passage or problem, locate relevant information, make inferences and solve problems based 
on the information provided. Given recent revisions, the tests now emphasize higher-level thinking and 
problem-solving skills, check for an awareness of computer technology and consumer skills, and relate 
questions to adult settings, roles, and work-related skills (Swartz, et al., 1988). 

Additionally, the GED Testing Service (1991) obr rves that the test-taking process to which examinees 
are exposed requires mental and physical skills that may be applicable to both job and postsccondary 
educational situations. Some of the skills necessaiy for successfully completing the tests are: a) listening and 
reading; and b) the ability to comprehend and process procedural information, apply test-taking strategics, 
follow procedures, and understand and follow oral and written instructions. Examinees must also be able to 
concentrate on written material and to sit for an extended period of time. 

The above skills are not intended to address the specific educational skill requirements of employers. 
However, Webb (1991) argues that they either directly or indirectly address mnny of the noncDnicxlual basic 
skills considered by employers in service, manufacturing, and a variety of other businesses and iiuluslrics 
across the U.S. to be important personal attributes. She suggests that the GED directly measures many of 
the behavioral and work process skills such as learning how to learn, creative thinking, problem solving, work 
habits and attitude that employers seek in employees. The skills measured indirectly include ihc less 
quantifiable work process skills such as leadership, teamwork and interpersonal skills, and orgaiiiwaional 
effectiveness. Those employer-recommended skills that are not addre.s.sed by the GED include speaking 
ability or desired altribules such as pleasant pcrsonalily, willingness to aceepl responsibility, inlegi ily, and 
neat appearance. 



METHODOLOGY 

An ex posl faclo research design was selecied to invcsligatc the research questions raised ah(wc. Ex 
post facto research is .syslematic empirical inquiry in which Ihc researcher does not have dircei conirol ol 
independcnl variables, (e.g., the age, gender, eihnieily, grade levels complcied, moiivaiion of suhjecls, cic.) 
tecause their manifestations have already occurred (Kerlinger, 1973). Therefore, inferences abnul relaiions 
among variables are made without direct intervcniion, from coneomilant variation of indcpendeni and 
dependent variables (e.g., rates of passing, failing, or not complciing the GED Tc'^is). Given (hat GED test 
examinees come already assigned lo ihe groups who were affeclcd by Ihe change in .score reciuiremenis (e.g., 

^^,3 BEST copy flVAIlABlE 



those taking the tests after 1988) and those not affected by these requirements (e.g., those taking tests prior 
to 1988), the researcher cannot state a causal connection. There are a number of other variable.s (or 
combinations) which may cause a statistically significant interaction. Because it is possible to set up and test 
alternative or ''contror hypotheses, the goal is to identify every rational explanation of new phenomena, and 
to develop every tenable hypothesis respecting its cause and history (Kerlinger, 1973). 

Kerlinger (1973) also argues that the method of testing alternative hypotheses is particularly important 
in ex post facto studies, because it is one of the only ways to '"control" the independent variables of such 
research. This approach calls for a simulated ''before-after'' design in which the researcher uses as pretest 
measures the measures of another group which are chosen to be as similar as possible to the experimental 
group and thus a control group of a sort. However, the controls are weak, a result of the inability to know 
that the two groups were equivalent before the treatment. 



Sampling Process 

The research employed a two-stage sampling design through which data could be collected Trom a 
representative sample of Wisconsin GED test examinees Tor two years: 1986 and 1989. During phase one, a 
Selection with probabilities proportional to size" random sampling process (Kish, 1965) was used to select 
the GED test storage sites from which to collect data. This sampling design was considered to be the most 
appropriate because it allowed lest sites of varying sizes proportional representation in the fnuil sample. 
Information obtained from DPI and a telephone survey of active test sites indicated there were 47 storage 
sites in the slate. The study sought to collect data from <nbout one third of the sites, therefore 16 (34 %) ol 
the sites were targeted. The last full year before the implementation of score requirements was 1986. 
Examinees during this year appeared to be typical of those that preceded them in terms of the numbers 
tested, and the percentage completing and passing the tests: 14,157 were tested, 8,319 completed all five tests, 

4 

and 7,806 (or 78.4 percent) met the score requirements (1986 GED Statistical Report) Thcrclorc. ihc P)S(> 
examinees served as a ''quasi** control group. 

The second year for diila collection was 1989, which was a full year after the implementation of the 
score requirements. This group of examinees served as a ''quasi** experimental group. During this year about 
7,228 examinees were tested in Wisconsin: 3,311 completed all five tests, and 2,671 (69.1 percent) met the 
new .score requirements (1989 GED Statistical Report). 



Data files were obtained on a sample of 30 examinees from each site, for each year. Thererore, a 
sampling frame was created which rank ordered each storage site in terms of the number of cxuiiiinccs 
tested in 1989 and a sampling fraction was computed and used to establish eight zones, from which two of 
the sites could be selected. The total sample for each year was 480, and the total for both years was 960. 
For 1985 the sample represents 339 percent of the population and each examinee in the sample represents 
about 29.49 persons in the population. For 1989, the sample represents 6.64 percent of the population and 
each examinee represents about 15.06 examinees in the sample. 

The data collection process was carried out over a Five month period by the principle invcsiigator and 
a graduate assistant. Eleven of the sites were visited, by either the principle investigator or the graduate 
assistant, and a table of random numbers was used to select individual examinee files for the study. On other 
occasions, GED test officials at the sites were provided with instructions for conducting random surveys and 
given a set of random numbers to select Hies for rK«^ study. Complete files with addresses, GED lest scores, 
test sites, age, last grade completed, reason for taking the tests, and other data were obtained on ^H)0 
examinees. In the remaining case, state law prohibited officials at a correctional facility from releasing 
personal data on current or previous inmates. Therefore, officials at the site complied with a request to 
provide specific demographic and GED related data on a random number of 60 individual inmaies who took 
the tests in cither of the two years. Therefore, this phase of the sampling process was eompleted with a 
sample of 960 examinee data files. 

During the second phase, a follow-up survey was mailed to 900 of the individuals included in I he 
original sample. The sample of sixty obtained from the correctional facility were excluded from llie I'ollow-up 
sample because of the »bove referenced legal requirements. Data collection was terminated after a secon^i 
follow-up sui-vcy was sent to those examinees who did not respond to the first mailing. A lotal of 347 
surveys were returned by the Post Office as **not deliverable^ Completed surveys were relurned l)y 206 
respondents, and 553 did not respond. Therefore the effective response rate was 37.25 pereeni. 

Using Chi-square and t-lests, an analysis was conducted to dclcminc the exieni lo which those who 
did return the surveys differed from ihosc who did not return them. The Chi-square analyses, :ii Ihe .05 level 
of significance, was employed lo delermine the extent to which there were significant dilTcrences in the 
gender, age, and .status (i.e., passed, failed, or did not complete the (jED). These analyses found no 
significant gender differences for the 1986 examinees. However, for both years, those returning surveys 
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differed signincantly from their counter parts who did not return them. For those taking tests in 1989, 
significantly more women (34.6%) returned surveys than men (17.7 percent). 

For both years, significantly more older examinees (ix,, those ages 19*35 and 36-70) completed surveys 
compared to younger examinees rhose 17 and 18 years of age), Significaytly more of the examinees who 
passed the G^D tests returned the surveys, compared to those who either failed or did not complete them. 
Additionally, t-tests of total score means and average score means revealed that for both years, those who 
returned the surveys obtained significantly higher scores than those who did not return them. 

Limitations of the Study 

In addition to the design weaknesses that are endemic to an ex post facto research design, this study*;; 
small rate of return for mail surveys is also problematic. Although the overall return rale of 37.25 pcrccni is 
"good" for GED examinees in comparable studies, e.g., Ccvero (1983), the fact that those who returned the 
surveys were statistically noi representative of ihe demographic makeup of the original samples for each year 
raise questions of validity. However, given that the addresses for the 1986 sample were five years old, and the 
1989 addresses were two years old, this problem was not unexpected. These data represent the best data 
available, therefore, they were used to carry-out the purposes of the study. However, the findings from these 
data should be interpreted with caution. 

Instrumentation 

The Survey instrument (sec appendix I) consisted of an eight*puge survey form which was developed 
in two stages. First, questions of interest were drawn from a variety of published and nonpublishcd GED 
related research, and the resulting questionnaire was revised several times to meet the content rcquiremcnis 
of ihc principle investigator and the graduate assistant. Second, a draft of the survey was mailed to a sample 
ol f)() (JED icsl examinees, who were nol part of ihe final sample. Based on iheir response palterns U) 
questions in the survey and their responses to queries regarding the statements and queslions on the survey, 
several (|ucstions were eliminated, revised, or changed in the format of the survey. The final survey was 
comprised of "closed iiem-response choices,** and obtained data on each examinees' motivations for and 
proccss(es) used to take the GED; employment informaticm; other benefits of the GED; and demographic 
information. 

IS 



ANALYSIS OF DATA 



The 1987 changes in Wisconsin's GED score requirements could have initiated a variety or changes in 
the attitudes, perspectives, and behaviors of examinees at several levels or the GED testing process. This 
study sought to determine the nature and extent of these changes by employing a variety of quaniitntivc 
statistical analyses to address the research questions raised above. For each analysis the probability level was 
set at .05. 



Examinees' Entering Characteristics 

The first research question is concerned with the extent to which the changes in score rc(|uircmciits 
effected the demographic and academic characteristics of the two groups of examinees. The dala presented 
in Table 1 compares the demographic and academic characteristics of 1986 and 1989 examinees. Analysts of 
Variance tests were used to test the null hypothesis that the gender and ages of the examinees did not 
change significantly during the two years. The analysis found that there were significantly more women (52.7 
percent) than men (4S.4 percent) who took the tests in 1989 and that the 1989 examinees were significantly 
older (i.e., averaging 25.3 years of age) than those in 1986 who average 24.89 years of age. Therefore, the 
null hypothesis was rejected. 

Insufficient data was obtained on the race/ethnicity of the examineest however, an analysis of variance 
test was used to test the null hypothesis that there were no signiHcant differences in I he part icipnt ion of 
examinees from Urban vs. Rural locations of the test sites during the two years. No significant diflerenees 
were found, therefore, the hypothesis was accepted. Chi-square analyses of Tast Grade Completed^ 
"Grades Obtained in High SchooP, '^Marital Status^ and **Rcason for Pursuing ihe (lED*" lotind no significant 
differences. Although Ihe reasons for taking the tests changed only slightly during the two years, the majority 
of examinees during both years took the tests to obtain further education and empioymcni. The greatest 
change occurred in the 16.32 percent of those who took the tests for personal satisfaction in 1989 compared 
to .006 percent in 1986. 
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Table 1. 

Demographic and Academic Characteristics of the Sample 



Characteristics 




1986 




1989 




N 


% 




% 


Gender: 










Female 


216 


45.0 


253 


52.7 


Male 


250 


511 


218 


45.4 


Ethnicity: 










African American 


20 


42 


33 


6.9 


Hispanic 


3 


.6 


12 


2.5 


White 




17 7 

11,1 






Asian 






2 


.4 


American Indian 


1 


2 


3 


.6 


Missing 


371 


713 


196 


40.8 


Reason for GED: 


N- 


325 Responses 


N» 288 Responses 


Further Educ. 


183 


56.31 


148 


51.39 


ciiipioyiueni 


Q1 

Of 


Zb. 1 1 


65 


22.57 


Military 


15 


4.62 


8 


2.7« 


Personal Satisfaction 


2 


.006 


47 


16.32 


Other 


38 


11.69 


20 


6.94 


GED Slatuv 










Passed 


373 


77.7 


240 


50.0 


Failed 


33 


6.9 


80 


16.7 


Not Complete 


74 


15.4 


160 


33.3 


L«dsi vjraue v^ompicicQ. 


M «. 
iN « 


JcM) Kesponses 


N-371 


Grades 4 to 9 


89 


23.4 


85 


22.9 


Grade 10 


123 


32.36 


127 


34.2 


Grades 11 or 12 


168 


44.21 


159 


42.8 


Grades in High School: 


N- 


79 


N«127 


About B + and Above 


10 


12.7 


15 


11.8 


Mostly ^'C to ''B*' 


34 


43.0 


63 


49.6 


About T*** and Below 


35 


44.3 


49 


38.6 


Age: 


N-480 


N«480 




Mean 




24.89 


25.30 


Standard Deviation 




9.57 


9.11 




N = 380 


N=.372 




Mean 




10.15 


10.19 


Standard Deviation 




1.1 


1.1 
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Table 2 provides a descriptive profile of the 1986 and 1989 examinees who returned surveys. Although this 
sample is more representative of the 1989 examtnees« due to their higher return rate, it does provide some 
useful insight into the perceptions and behaviors of 1986 examinees. The data in both tables will l>e analyzed 
in greater depth in subsequent analyses. 



Table 2 



Descriptive Characteristics of the Sample; 1986 and 1989 



r*^^^^^^haracie^^ 


N 


1986 
% 




1989 

% 


Pursued Study Options: 


48 


60.8 


105 


82.7 


Study uptionst 


pi » /y 




Iri " f 




Personal Tutor 


15 


19.0 


39 


30.7 


Video Programs 


11 


•13.9 


35 


27.6 


Studied alone- Books 


35 


44.3 


82 


64.6 


Practice Tests 


31 


39.2 


80 


63.0 


Instructional T.V. 


A 

V 


1 1 if 

11.4 




9^ "> 


Aiienacu ucarning v^enier/i^iass. 










Number of Weekly Hrs. Studied: 








• 


2 Hrs. or less 


30 


40.0 


31 


24.4 


3-10 Hrs. 


34 


43.0 


70 


55.1 


11 or more Hrs 


12 


15.2 


23 


18.1 


Number of Weeks Studied: 










4 Wks. or less 


32 


40.5 


41 


32.3 


5-16 Wks. 


29 


36.7 


42 


33.1 


17 or more Wks. 


13 


16.5 


39 


30.7 


tyiain wage earner. 






^0 


3y 4 


Income in 199(): 










0--$4.999 


9 


11.4 


35 


27.6 


$5,000.-$10,999 


15 


19.0 


42 


33.1 


$11,000"$19,999 


30 


38.0 


28 


22.0 


$2Q,000--and Over 


19 


24.1 


18 


14.2 


Tcid GED is Required 










for Employment : 


40 


50.1 


74 


5R..1 


1-2 times 


10 


12.7 


25 


19. 7 


3 or more times 


17 


21.5 


31 


24.4 




Table 2 Continued 



Descriptive Characteristics of the Survey Sample: 1986 and 1989 



Characteristics 


1986 


1989 






% 




% 


Current Employment 










Status: 










run* lime M't nrs./WK 


56 


71.0 


75 


58.1 


Part-Time -35 Hrs./Wk 


9 


11.4 


15 


11.8 


Unemployed-Looking 


7 


8.9 


15 


11.8 


Unemployed-*Not 










Looking for work 


5 


63 


19 


15.0 


Employment Status Prior to taking the 










GED: 










ruu* I iniw 


30 


38.0 


49 


38.6 


Part-Time 


■ il 


13.9 


19 


15.0 


Unemployed**Looking 


•J 


8.9 


17 


13.4 


Unemployed--Not 










Looking 


9 


11.4 


16 


12.6 


Primary Source of Financial Support: 










Personal Employment 










Public AssH. 


44 


55.7 


68 


53.6 . 


Spou' 5 


4 


5.1 


25 


19.7 


Other 


19 


24.1 


24 


18.9 




8 


10.1 


7 


5.5 


Public AssH. Status: 










Received before GED 


11 


13.9. 






Received during GED 


9 


11.4 


42 


33.1 


Received after GED 


9 


11.4 


35 


27,6 


Currently receive PA 


5 


6.3 


32 


25.2 








24 


18.9 


1 Income since taking the GED: 










Increased 


46 


58.2 


47 


37.0 


II Decreased 


3 


3.8 


12 


9.4 


Has not changed 


24 


30.4 


62 


49.0 


Enrolled in Education/ 










II Training Program: 


26 


32.9 


47 


37.0 
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Examinees^ Reactions 

The second research question seeks to determine the extent to which the two groups of examinees 
differed significantly in the strategies they used to prepare for the GED tests and in their assessments of the 
effectiveness of the preparation programs they attended. Data in Table 2 provide some of the examinees' 
survey responses to questions involving their study strategies. These data suggest that from 1986 to 1989 the 
percentage of examinees pursumg study options other than taking classes, e.g.| personal tutor, video 
programs, etc, increased by 21.9 percent. Although ail of the study options listed experienced increases, the 
greatest increases occurred in the areas of using practice tests (23.8%) and studying alone using GED 
preparation books (203%). Also, the percent of examinees who participated in classroom instruction 
increased a modest 8.6 percent between the two years* 

A Chi-square analysis of three categories of weeks of study (0-4, 5-16, and 17 or more) [see Table 2| 
was conducted to test the null hypothesis that there were no differences between (he 1986 and 1989 
examinees. The analysis found that the 1989 examinees studied for significantly more weeks than (hose in 
1986: 32 percent of the 1989 examinees studied 17 or more weeks compared (o 17.6 percen( of (he 1986 
examinees. Also 36.6 percent of the 1989 examinees studied (M weeks, compared to 43.2 percent of (he 1986 
examinees (X' s4.23,df»l,P<.04).The null hypothesis was rejected. A similar analysis of (he number of 
hours s(udied per week found no significant differences, and the null hypothesis was accepted. 

Another analysis was conducted to determine if there were differences in the number of weeks 1989 
examinees studied as compared to their pass/fail rates. A Chi-square analysis of the three categories of 
weeks studied found that signiHcantly more of (he examinees in 1989 who failed (47.6%) were among those 
who studied 17 or more weeks, as compared to the low percentage of those who passed (23.8%). Also, 19 
percent of the 1989 examinees who failed studied 0-4 weeks, and 41.3 percent of those who pas.sed studied 
for this period (X^ « 8.85, df = 1, P < .003). 

The data in Table 3 examine the null hypothesis that examinees' assessn^i-nl of their experiences in 
adult secondary education classes and programs did not differ significantly between 1986 and 1989. This 
hypothesis was accepted for all the statements except the Hrst one, i.e.. Knowledge Dcvclopmcni. 
Significantly more of the 1986 examinees (88 percent) compared to (76 percent) of 1989 examinees positively 
responded to the statement (X^ « 4.47, df « 1, P < .04). 



Although no other significant difTerences were found, the examinees' responses do reveal a favorable 
disposition toward academic integration statements (i.e., # 1 • 4). A total of 87 percent of 1986 examinees 
and 77.25 percent of 1989 examinees agreed to the positively worded statements. However, these patterns 
were largely reversed for the social integration statements (i.e., # 5 - 8). A total of 60 percent of 1986 
examinees and 56.75 percent of 1989 examinees disagreed with these positively worded statements. 



Table 3 



Examinees' Assessment of Their Experiences in 
Adult Secondary Education Classes and Programs 



Exairinees' perception of their 

U PXnfTiCnCA^ in ARF nrnctrsimc 


1986 
n 

(%) 


1989 
SD D A SA 
n 

(%) 


11 1 I Am cuticfif^rl U/itli t\%m ^vt^nf nf 
H A* 1 aiii aallallwU Willi Inw wXlCnl Ul 

my knowledge development. 


0 5 29 11 
(0) (11) (64) (24) 


(9) (15)(58) (18) 


2. My experiences had a positive 
influence on my interest in ideas. 


1 9 25 9 
(2) (21) (57) (21) 


6 14 47 17 
(7) (17) (56) (20) 


3. Instructors were genuinely 
superior teachers. 


0 7 22 14 
(0) (16) (51) (33) 


7 14 34 30 
(8) (17) (40) (35) 


4. Instructors were generally 
interested in students. 


0 1 29 16 
(0) (2) (63) (35) 


5 11 30 41 
(6) (13) (35) (47) 


5. 1 developed close personal 
relation- 

ships with other students. 


10 19 8 5 
(24) (45)(19) (12) 


22 36 17 9 
(26) (43)(20) (11) 


6. Studeiit friend- 
ships have been per- 
sonally satisfying. 


7 18 9 6 
(18) (45)(23) (15) 


17 40 20 5 
(21) (49)(24) (6) 


7. Non-classroom dis- 
cussions with instructors influenced 
my personal growth. 


4 14 13 8 
(10) (36)(33) (21) 


15 23 28 17 
(18) (28)(34) (21) 


8. Non-classroom dis- 
cussions with in- 
structors influenced 
career goals. 


5 19 8 7 
(13) (49)(21) (18) 


10 25 32 16 
(12) (30)(39) (19) 


SD * Strongly Disagree 

D s Disagree 

A = Agree 

SA a Strongly Agree 
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Table 4 



Examinees' Assessment of how Helpful the Classes/ 
Programs were in Developing Academic Skills 



1 How helpful were the classes for: 


1986 

NH OLH SH VH 
n 

(%) 


1989 

NH OLH SH VH 
n 

(%) 


1. Improving reading 
skills. 


4 o ZZ 11 
(9) (18) (48) (24) 


O lit AA ^/i 

o 10 44 10 
(10)(19) (52) (19) 


D 2. Improving math skills. 


1 3 22 27 
(2) (6) (47) (45) 


4 10 42 31 
(5) (12) (48) (36) 


3. Improving writing skills. 


2 16 16 10 
(5) (36) (36) (23) 


9 21 34 21 
(11) (25)(40) (25) 


4. Increasing your knowledge of 
science. 


4 13 22 7 
(9) (28) (48) (15) 


9 22 41 13 
(11) (26)(48) (15) 


1 5. Increasing your 

knowledge of social studies. 


0 13 24 8 
(0) (29) (53) (18) 


6 19 45 16 
(7) (22) (d2) (19) 


6. Improving your test-taking 
skills. 


2 7 17 20 
(4) (15) (37) (44) 


A ^A 

4 24 30 27 
(5) (28) (35) (32) 


#. increaaiiig yuui avii*wiiniiucnv'C 


U 7 21 20 
(0) (14) (44) (42) 


0 17 24 3y 
(7) (20) (28) (45) 


8. Helping you pre- pare for 
' further education. 


6 8 K> 15 
(13) (18)(36) (33) 


5 19 27 35 
(6) (22) (31) (41) 


D 9. Helping you improve job 
1 related skills. 


8 7 21 10 
(17) (15)(46) (22) 


16 24 23 23 
(17) (28)(27) (27) 



NH« Not Helpful 
OLH « Of Little Help 
SH« Somewhat Helpful 
VH» Very Helpful 



The data in Tabic 4 examine the null hypotheses that the examinees* assessment of the helpfulness i)f 
preparatory classes/programs in developing their academic skills did not differ significantly between the two 
years. This hypothesis was accepted for all statements. Over 78 percent of 19S6 and 73.0 percent of 1989 
examinees felt most adequately prepared in the areas of improving Math Skills, increasing Scir-ConUdcncc, 
improving Test Taking and Reading Skills, increasing their knowledge of Social Studies, and receiving help in 
preparation for Further Education. However, only 633 percent of 1986 and 60.67 percent of 19S9 examinees 
indicated that their preparatory programs were either ''somewhat** or **vcry** helpful in increasing their Job 
Related Skills, and improving their knowledge of Writing and Science. ^ 

BESTCBPyjIVAIUBtE 

^ 25 



Examinees' Test Performance 

To address the third research question, a series of Chi* square analyses were conducted to test the 
null hypothesis that there were no differences in the GED status of the examinees during the two years. 
This analysts confirmed earlier observations that significantly more examinees failed or did not complete the 
tests (16 J% and 335%) in 1989 than in 1986 (7.1% and 15.2%) (X^ « 69.96, df « 1, < P.000).The null 
hypothesis was rejected. 

The data in Table 5 illustrate the dramatic difference in the pass/fail rate before and after the change 
in score requirements. In 1986 75 percent of students taking the tests received a passing score on the first try, 
compared to 48.1 percent in 1989. Although the percentage of examinees seeking retests were nearly equal 
for the two years (41.3 percent for 1986 and 40 percem for 1989) higher percentages of examinees in 1986 
received passing scores on either iheir first or second rctest (57 and 33.3 percent) compared to 22.2 and 8.3 
percent in 1989. There was also a steep increase in the number of examinees who failed to complete all five 
tests. In 1986 only 15.4 percent of examinees failed to complete the tests, but in 1989 that figure increased by 
fifty percent to 33.3. 

Additional analyses of examinees performance analyzed alternative null hypotheses concerning 
differences in the pass, fail, and noncompletion status of examinees for both years that might be do to age, 
gender, and location of test site (i.e., urban/rural). The null hypothesis in each analysis was accepted. 
However, in analyzing the demographic composition within each set of examinees, a significant difference 
was found in GED status by age for 1989 examinees. Older examinees were more likely to be among those 
who passed. Of those who passed* 23.2 percent were 17-18> 62.7 percent were 19-35, and 14.2 percent were 
36-70. Whereas, 32.2 percent of those who failed were 17-18, 56.1 percent were 19-35, and 11.7 percent were 
36-70. (X^ » 3.92, df « 1» < P .05). Also, signiHcantly more men (8.8 and 17.6%) than women (5.1 and 
10.6%) cither failed or did not complete the tests in 1986 (X^ « 6.93, df « 1, P < .008). There were no 
differences in the gender related performance on the tests for 1989. 

Further analysis of these data show that examinees in 1986 who completed higher grades in school 
were more likely than those completing fewer grades to have passed the tests. Over 50 percent of those who 
completed 12, 11, 9 and 8 grades in school were among those who passed. Whereas over 50 percent of those 
who completed 10, 7, 6 and fewer grades were among those who failed. (X^ « 4.04, df = 1, P < .04). There 
were no differences, based on the grade level completed, in the performance of 1989 examinees. 
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Table 5 



Examinee Status by Test Year: Pass, Failed and Incomplete 





All Examinees 
% (n) 


First Retest 
% (n) 


Second Rciesi 
% (n) 


1 Passed 
1 1989 

1 

\ Difference 


48.1 (231) 
75.00 (360) 
-26.9 (-129) 


22.2 (8) 
57.9 (11) 
-35.7 (-3) 


83 (1) 
333 (2) 
'25.00 (.1) 


1 Failed 
1 1989 
1 1986 
1 Difference 


I8i (89) 
9.6 (46) 
9.8 (43) 


77.8 (28) 
42.1 (8) 
35.7 (20) 


91.7 (in 
66.7 (4) 
25.0 (7) 


y Incomplete 
1 1989 

1 

y Difference 


33.3 (160) 

15.4 (74) 
17.9 (86) 







Were there significant dirrcrences between the mean scores on each test, average slandaril scores, and 
total scores or examinees Tor 1986 and 1989? Table 6 provides the results of a t-test analysis of the hypothesis 
that there were no signiflcimt difrercnces between the mean scores of examinees Tor each or the two years. In 
each instance, the hypothesis was rejected. The 1989 examinees out performed the 1986 examinees on all 
tests, except the Writing Skills test. This was the only test in which the 1986 examinees out performccl those 
in 1989. Although this dirrerence is statistically significant, it may be or little practical value because the 
margin oi dirrerence is less than one point. 

Additionally, the mean scores of 1986 examinees averaged 5.7 points above the 45 points rec|uirecl Tor 
passing each of the tests, thereby boosting their Average Standard Scores and Total Scores 53 ;incl r>().iS 
points, respectively, above the averages required for passing. The mean scores of 1989 examinees averaged 
only 1.8 points above the 50 points required. Thererore the Average Standard Scores and Tola! Scores lor 
1989 examinees were only 1.3 and 14.2 points, respectively, iibove the avcniges required Tor passing. 




Table 6 

T-tests Analyzing Test Score Means By Year 



Test 


1986 


1989 


t 


Prob. 




Mean 


Mean 


(dO 






(n) 


(n) 






writing skills 










(424) 


(367) 


(78438) 




50C1&1 dCUQieS 






+ 4J5 


000 




(449) 


(415) 


(847J3) 






5167 






012 




(450) 


(411) 


(838.55) 




Keading 


^1 fil 


^ Id 




000 

•lAAl 




(437) 


(851.05) 




iviuincniaiiws 


49.10 


50.09 


+ 2.02 


.044 




(423) 


(370) 


(772.46) 




Average 


50.29 


51.32 


+ 2.41 


.016 


Standard 


(480) 


(478) 


(953.54) 




Score 










Total 


255.80 


264.15 


+ 3.69 


.000 


Scores 


(407) 


(318) 


(679.47) 





Are there significant differences in the original test score means for each individual test, Average 
Standard Scores, and Total Scores for examinees in 1986 and 1989 who took all five tcs*? Table 7 provides 
the results of t-tests which were conducted to test the null hypothesis that there were no significant 
differences in the mean scores for each group of GED examinees who took all five tests. These hypotheses 
were rejected for all test score means, with the exception of the Writing Skills lest. 

Those examinees taking all five tests for the first time had scores wcii above the average requirements 
for passing during their respective years, The 1986 examinees aveniged 7.34 points above the 45 points 
rei|uired for each test and 7.21 and 36.73 points respectively above the requirements for the Average 
Standard Score and Total Scores. The 1989 examinees averaged 5.5 points above the SO points required for 
each test, and 5.5 and 27.8 poinis respectively above the requirements for the Average Standard Score and 
Total Scores. In direct comparisons, the test scores of the 1989 examinees were significantly higher than 
lho.se of the 1986 examinees for all tests, except the Writing Skills test. However, the margin of po\m above 
the average required was consistently highest for the 1986 examinees. 



26 

2S 



Table 7 



T-tests Analyzing Original Test Score Means by Year 
for Examinees Taking All Five GED Tests 



1 Test 


1986 
Mean 
n«360 


1989 
Mean 
n«230 


.1 

y lis. 

(dO 


Prob. 


1 Writing Skills 


51.43 


51.44 


.03 
(526.63) 


.98 


1 Social Studies 


52.76 


57.47 


9.06 
(509.74) 


.000 


1 Science 


53.46 


56.87 


6.59 
(500.27) 


.000 


Reading 


53.79 


59.08 


8.72 
(456.16) 


.000 


Mathematics 


50.26 


52.88 


5.29 


000 


Average 
Standard 
Score 


52.21 


55.48 


7.97 
(549.47) 


m) 


1 Total 
1 Scores 


261.73 


277.81 


7.92 
(546.48) 


.(KK) 



Were there significant differences in the mean scores for each lest, Average Standard Scores, and 
Total Scores for examinees who failed their original tests and took retcsts in 1986 and 1989? Table 8 
provides the results of t-tests which were conducted to test the null hypothesis ihai the differences in mean 
scores of retest examinees were not statistically signiFicant for the two years. For each of the tests, and for 
both the Average Standard Scores and Total Scores, the hypothesis was rejected. 

The 1986 retest examinees averaged 2.9 points below the 45 points required for passinjj each test, and 
3.0 and 14.5 points respectively below the averages requires for Average Slandaril Scores and Total Scores. 
However, the 1989 retest examinees averaged 4.3 points below the 50 points required for passing each test, 
and 4.5 and 21.8 poinv respectively below the requirements for Average Standard Scores and Ti)lal Scores. 
In direct comparisons, the 1989 examinees obtained test scores that were significanily higher than ihi)se of 
the 1986 examinees for each test and for Average Standard Swrcs and Total Scores. However the 1986 reiesi 
examinees maintained average scores that were consistently closest to their requirements fi)r passing. 
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Table 8 

T-tests Analyzing Retest Score Means by Test Year 
of Examinees who Failed Their First Test 



Test 


1986 
Mean 
n-46 


1989 
Mean 
n-89 


(dO 


Prob. 


Writing Skills 


40.76 


43.65 


4.00 
(124.16) 


.000 


Social Studies 


42.11 


4632 


5J1 
(100.42) 


.000 


Science 


43.22 


47.48 


6.06 
(124.76) 


.000 


Reading 


43.41 


46.69 


3.63 
(94.25) 


.000 


Mathematics 


41.04 


44.17 


3.30 
(I02il) 


.(X)l 


Average Standard 
Score 


41.98 


45.51 


7.34 
(119.19 


.m 


Total Score 


210J4 


228.17 


7.22 
(118.51) 


.000 



Is there an interaclion between the errects or age and test-year that could account Tor the dirfcrenccs 
in average scores? The F-value associated with age provides a test of the hypothesis that age does not affect 
Average Standard Scores. The F-vahies associated with test-year tests the hypotheses that test-year has no 
main effect on Average Standard Scores. The F-value associated with the interaction between age and test- 
year tests the hypothesis that age docs not interact with test year, i.e., that there were no differences in the 
Average Standard Scores among the age groups across the two years. The data in Table 9 indicate 
statistically significant main effects due to age and test-year« but a nonsignificant level of interaction. The 
hypothesis thai age differences had no effects on Average Standard Scores was accepted. Other analyses of 
variance compulations tested the null hypotheses that gender, and geographical location (urban vs. rural), 
had no affect on the Avenige Standard Scores across the two years. These analyses did nol result in 
significant levels of interaclion, and the hypotheses were accepted. 
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Table 9 

i 

Analysis of Variance of Average Standard Score 
by Age and Test- Year 



Source 


SS 


df 


MS 


F 


Sig. 


Main Effects 


1211.44 


3 


403.813 


11.20 


.000 


Age 


709.17 


2 


354o9 


9.83 


.(XXI 


Test-Year 


458.24 


1 


458.42 


12.70 


.000 


2>Way Interaction 


167.14 


2 


83.57 


232 


.099 


Age Test- Year 


167.14 


2 


83.57 


232 


.099 


CJipi ttl n wU 




5 


275 72 


764 


000 


Residual 


25357.97 


703 


36.07 






Total 


26736.55 


703 


37.'6 












Table 10 








Analysis of Variance of Reading Test Scores 






by Age and Test- Year 




Source 


SS 


df 


MS 


F 


Sig. 


Main Effects 


2436.84 


3 


812.28 


11.90 


.000 


Age 


1200.13 


2 


600.07 


8.79 


.000 


Test-Year 


1092.44 


1 


1092.44 


16.01 


.000 


2'Way interactions 


527.65 


2 


263.82 


3.87 


.021 


Age Test- Year 


527.65 


2 


263.82 


3.87 


.021 


Explained 


2964.49 


5 


292.90 


8.69 


.000 


Residual 


59577.55 


873 


68.25 






Total 


62542.04 


878 


71.23 







Docs agCt gender, and geographical loeation interact with (es(*year lor the mean scores on each of the 



tests? To test ihc hypothesis that there was no interaction between age, gender, and geographical location 
and test score means, two-way ANOVAs were computed to lesi each hypothesis. The hypotheses were 
accepted for all tests except the Reading test. On the Reading test, u significant interaction occm red which 
could explain the high average score (54.14) obtained for the 1989 examinees, compared to the (5L81) 
average for 1986 examinees (sec Tabic 10). Apparently, older examinees are significantly bcHcr readers, and 

ERIC 



because (hey made up a signincantly larger segment of 1989 examinees, (hey made a signincan( dilTerence in 
the Reading test score. 



I Test Performance or Noncompleters 

j The fourth research question addressed the concern that the increased score requirements could have 

been a disincentive for those examinees in 1989 who failed to complete all Five tests. That is, were there 
^ signiHcant differences in the original mean scores on each of the tests and Average Standard Scores, for 

' examinees who did not complete all five tests in either 1986 or 1989? Table 11 provides (he results of t*tes(s 

^ T which were conducted to test the hypothesis that there were no significant differences in the mean scores of 

1986 and 1989 noncompie(ers. Given that 1989 noncompleters significantly out performed 1986 
noncompleters on two of the (csis, (his hypo(hesis was rejected for the Social Studies and Reading (csts. ancl 
Average S(andard Scores, hut was accep(ed for the Wri(ing Skills, Science, and Mathematics tests. 



Table 11 



T-(es(s Analyzing Original Score Means by Tes( Year 
for Examinees Who did No( Comple(e All Five Tes(s 



Test 


1986 


1989 


t 






Mean 


Mean 


(dO 


Prob. 




(n) 


(n) 






Writing Skills 


46.C1 


4435 


-1.02 






(18) 


(48) 


(25.86) 


318 


Social Studies 


44.49 


4937 


3.89 






(43) 


(96) 


(83.50) 


m) 


Science 


45.91 


48.38 


1.90 






(44) 


(92) 


(88.77) 


.060 


Reading 


45.81 


50.11 


3.66 






(54) 


(118) 


(133.84) 


m) 


Milt hematics 


46..35 


47.82 


.63 






(17) 


(51) 


(23.64) 


.533 


Average Sliindnrd 


46.04 


48.60 


2.57 




Score 


(74) 


(159) 


(143.51) 


.011 
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Those examinees who did not complete all Five tests in 1986 averaged ^ points above the 45 points 
required for each test and 1.0 point above the requirement for Average Standard Scores. However, the 1989 
noncompleters averaged 2.0 points below the SO points required for each test, and 1.4 points below the 
requirement for the Average Standard Score. Noncompleters in 1989 tended to score fewer than (he average 
of SO points needed to pass the tests in that year. This is true of 4 of the five tests ind the Average Standard 
Score. In contrast, on 4 of the Five tests, 1986 examinees did obtain the 45 point average needed to pass the 
tests in that year. 



Table 12 

T*tests Analyzing the Mean Scores of Completers 
and Noncompleters for 1986 



Test 


Completers 
Mean 
(n) 


Noncompleters 
Mean 
(n) 




Prob. 


Writing Skills 


50.22 
(406) 


46.61 
(18) 


1.79 
(18.23) 


.09 


Social Studies 


51J6 
(406) 


44.49 
(43) 


6.50 
(52.11) 


.(XX) 


Science 


52.30 
(406) 


45.91 
(44) 


5.78 
(52.33) 


.000 


Reading 


52.61 
(406) 


45.81 
(54) 


7.19 
(73.09) 


.000 


Mathematics 


49.21 
(406) 


46.35 
(17) 


1.35 
(16.82) 


.196 


Average Standard Score 


51.05 
(406) 


46.04 
(74) 


5.73 
(1)3.84/ 


.000 
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The exicnl to which iWz mciin scores of completers difrcrcd from those of noncomplclcrs lot a given 
year could provide adUilional evidence of the extent to which the new score requirements served as a 
disincentive for 1989 noneompleiers. To lest the null hypothesis that the mean scores of noncomplclcrs did 
not differ sigtiincantly from those of completers for 1986, t-tests were conducted on all five tests and Average 
Standard Scores for these iVv^ groups. Tzblc 12 provides the results of the analysis. The null hypothesis was 
rejected for those examinees who took the Social Studies, Science and Reading tests, and for the Average 
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Standard Scores of examinees. The hypothesis was accepted for those examinees who took both the Writing 
Skills and Mathematics tests. 

The mean scores for Completers averaged 6.2 points above the 4S required for each test and 6.1 
points above the requirements for the Average Standard Scores. The mean scores of Noncompleters 
averaged only .83 points on each test, and 1.0 points for the Average Standard Score above the requirement. 

A similar t-test was conducted on the mean test scores of 1989 examinees who either completed or 
failed to complete the tests. Table 13 provides the results of this analysis. The null hypothesis of no 
difference between the two groups was rejected for each lesi and the Average Standard Score. On each icsi. 
Completers significantly out performed Noncompleters. 

Also, the mean scores for Completers averaged 2.8 and 2.7 points above the SO points required for 
each re.sl and the Average Standard Score. However, the mean scores for Noncompleters averaged 2.0 and 
1.4 points below the requirements for each test and the Average Standard Score. 



Tabic 13 



T-tesls Analyzing the Mean Scores on Completers 
and Noncompleters for 1989 



Tesl 


Completers 


Noncompleters 


I 






Mean 


Mean 


(clO 


Prob. 




(n) 


(n) 






Writing Skills 


49.27 


44.35 


4.64 






(318) 


(159) 


(62.5) 


.(KX) 


Social Studies 


54.37 


49.36 


6.04 






(318) 


(C^j) 


(167.1) 


.000 


Science 


54.2f) 


48.38 


6.81 






im 


(92) 


(144.6) 


.000 


Reading 


55.62 


50.11 


5.94 






(318) 


(118) 


(216.5) 


.000 


Malhcm:ilics 


50.4r) 


47.82 


2.46 






v3l8) 


(51) 


(()().0) 


.OK) 


Average 


52.70 


48.60 


6.20 




Standard Score 


(319) 


(159) 


(277.4) 


.0(K) 
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Personal Benefits of the GED Credential 

The fifth research question is concerned with the personal benefits that might accrue to examinees 
who possess the GED credential. A Chi-square analysis of some of the data contained in Tabic 2 tested the 
null hypothesis that there were no significant differences in the proportions of examinees who enrolled in 
education or training programs for the two years. The analysis found that a sigr.ificantly higher percentage of 
1989 examinees had enrolled in educational/training programs compared to those in 1986: 37 percent of 1989 



examinees versus 32.9 percent of 1986 examinees were enrolled (X* ■ 5.72, df = 1, < P .017). The 



hypothesis was rejected. 

Additional analysis of these data found that a significantly higher percentage of those in 1986 who 
indicated further education (57.1%), employment (19%) or other (23.8) as a reason for pursuing ihc GED 
also incUcated that they had enrolled in an educational or training program (X^ » 3.71, df « 1, P < .05). 



Over 50 percent of both 1986 and 1989 examinees who possessed the GED certificate indicated it wa.s 
either somewhat or very helpful in their efforts lo qualify for two-year college and lo gel a job (see Table 
14). Conversely, a majority of the examinees from both years indicated the GED was either "not helpful" or 
"of little help" in getting a Promotion, or Keeping a Job. There was a statistically significant difference in the 
perceptions of examinees regarding the helpfulness of the GED toward Entering Four-year College: over 55 
percent of 1989 examinees rated it as helpful, while over 70 percent of 1986 cxiiminecs rated it as not hclplul 
(X^ -6.93,df = I, P< .008). 



l' 



Perceptions of the Degree to Which the GED was Helpful 
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Table 14 



Examinees' Assessment of the Extent to Which 
They have Found the GED to be Helpful 



How helpful was the GED to: 


1986 

NH OLH SH VH 
n 

(%) 


1989 

NH OLH SH VH 
n 

(%) 


1. Get a job. 


11 11 16 19 
(19) (19) (28) (33) 


16 13 12 22 
(25) (21) (19) (35) 


2. Keep a job. 


20 9 13 13 
(36) (16) (24) (24) 


22 16 8 7 
(42) (30) (15) (13) 


3. Get a Promotion. 


25 15 7 6 
(47) (28) (13) (11) 


26 15 8 6 
(47) (27) (15) (11) 


4. Qualify for two- 
year college. 


17 0 8 15 
(43) (0) (20) (38) 


15 2 6 31 
(28) (4) (11) (57) 


5. Qualify for four-year college. 


22 1 2 6 
(71) (3.2) (7) (19) 


19 1 6 19 
(42) (2) (13) (42) 



NH»NotHelpl'ul 
OLH » Of Little Help 
SH « Somewhat Helpful 
VH« Very Helpful 



Societal Impact of Possessing the GED 

The sixth research question is concerned with the effect of the changes in score requirements on 
examinees' employment status, income, and means of fmancial support. A Chi-squnrc analysis was used lo 
test the null hypothesis that there were no differences in employment status during the two years. It found 
that there were significantly more examinees employed in 1986 (either full lime 71.0% or part-time, 11.4%) 
than in 1989 (58.1% full time and 11.8% part-time) (X^ = 4.46, df = , P < .04). The hypothesis was 
rejected. However, this fmding could have resulted from (he fact that the 19S6 examinees had their 
credentials longer and thereby had more time to prepare for and search for employment. 
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Therefore, an alternative hypothesis was examined, i.e., that there were no difTerenccs in those 
examinees in 1989 who possessed a GED credential and those who did not (i.e., those who either failed or 
did not complete). This analysis found that those examinees who passed in 1989 were signincanlly more likely 
to be employed either full-time (67.1%) or part-time (13.9%) than those who failed (48.9 percent full time 
and 8.9 percent part-time). (X^ « 4.46, df « 1, P < .04). The hypothesis was rejected. 

Another aspect of personal benefit is personal income. A Chi-square analysis was conducted to lest 
the hypothesis that there were no differences in the personal incomes of examinees during the two years. 
This analysts found that there were significantly more examinees in 1986 who indicated (hey were in the 
higher income groups: 67.1 percent earned over $11,000.00 annually, compared to only 37.4 percent of (he 
1989 examinees (X^ « 13.907, df »1,P < .000). The hypothesis was rejected. 

There was also a significant difference bciween the **employmeni status** and **primHry source of 
financial support** for 1989 examinees. A total of 60 pe rcent and 33.3 percent of those '^unemployed and 
looking for work\ and SO percent and 44.4 percent of those ''unemployed and not looking for work** were 
either on public assistance or relied on a spouse or other nongovernment form of financial support (X^ » 
33.7, df » 1, P .000). 

An additional analysis found that there was a significant difference in the employment rate when 
compared to the Inst grade completed for 1989 examinees: those who c(miplctcd higher grade levels were 
more likely to be employed (X^ « 4.90, df = 1, P < .03). 

Differential Rates of Passing With Changing Score Requirements 

The seventh research question seeks to determine the differential rates of passing for GED examinees 
and the 1987 Norming Sample, given changing score requirements. The American Counsel on Education 
(ACE) identifies several different score requirement formulas that are ulili/ed by dilTerent states and 
territories. Table 15 provides an analysis of the percent of GED examinees who would have passed in 19iS6 
and 1989 given five different score requirements, and compares these with the results of the 1987 Wisconsin 
Norming Study. These data suggest that in the first three score requirement formulas, the GED examinees 
would have obtained higher passing percentages than the norming sample. Under the fourth formula, the 





normtng group out performed the 1986 GED group, but were out performed by the 1989 group* Under the 
Hfth requirement, the norming group slightly out performs the 1989 group, but greatly outperforms the 19S6 
group. As expected there is an inverse relationship between the increasing score requirements in the 
formulas and the percentage of examinees and norming study participants obtaining passing scores. 

Given the 1986 score requirements, 88.9 percent of the 1986 examinees passed the GED, and 90.3 
percent of the 1989 examinees would have passed. However, given the 1989 score requirements only 54.7 
percent of the 1986 examinees would have passed (a difference of 34.2 percent (or a decline of 139 
examinees); and 71.6 percent of 1989 examinees did meet the score requirements, which is a decline of 18.7 
percent (or 60 examinees) from those who would have passed in 1986. 



Table 15 

Effects of Different Score Requirements on Passing 
For 1986 and 1989 GED Examinees and 1987 Norming Sample 



Score Requiremenis 


1986 


1989 


1987 




(N = 406) 


(N«320) 


(N«913) 




Passing 


Passing 


Passing 




n 


n 


n 




(%) 


(%) 


(%) 


Minimum of 35 and 


3% 


306 


830 


an Average of 40 


(97.5) 


(95.6) 


(91.0) 


Minimum of 35 and 


361 


289 


767 


an Average of 45* 


(88.9) 


(90.3) 


(84.0) 


Minimum of 40 and 


344 


283 


721 


an Avciage of 45 


(84.7) 


(88.4) 


(79.0) 


Minimum of 40 and 


222 


229 


603 


an Average of 50** 


(54.7) 


(71.6) 


(66.0) 


Minimum of 45 and 


205 


189 


557 


an Average of 50 


(50.5) 


(59.1) 


(61.0) 



^^Tlicscor^cqmrcn^ 
**=Thescore rcquircmcnl for 1989. 



Differential Rates of Passing Given Minimum Scores 

The cighlh research qiicslion is concerned wiih Ihe differenlial rales of passing for ihe (JED 
examinees and ihe 19S7 Norming Sample, given four minimum scores: 35, 40, 45 and 50. The majorily of ihc 
.sialcs currenlly employ minimum .scores of eilher 35 (.30 siales) or 40 (19 slaies). Only one slale has a 
minimum rcquircmcnl of 45, and in lhal .slale ihc .score of 45 is ihc .sole requircmeni for pa.ssing ihc icsls. 
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This section analyses the passing rates of the 1986 and 1989 GED examinees and the 1987 Norming sampICi 
given these different minimum scores. 



Table 16 



Effects of Minimum Score Requirement of 35 on Rates of Passing 
Individual Tests: 1986 & 89 GED Examinees and 1987 Norming Sample 



Minimum Score: 
35 

Test 


1986 
Tested Passed 
N n 
(%) 


1989 
Tested Passed 
n 

N (%) 


1987 
Tested Passed 
n 

N (%) 


Wntmg 


424 421 

(993 


367 362 
(98.6) 


Ai 1 one 
913 895 

(98.0) 


Soc. Studies 


449 445 
(99.1) 


415 412 
(99.3) 


913 886 
(97.0) 


Science 


450 449 

(99.8) 


411 407 

(99.0) 


913 886 
(97.0) 


Reading 


460 456 
(99.1) 


437 433 
(99.0) 


913 877 
(96.0) 


Mathematics 


423 419 
(99.1) 


370 365 
(98.6) 


913 895 
(98.0) 



With a minimum score requirement of 35 on each individual lest, Tabic 16 illusualcs thai nearly all 
GED test examinees would have passed each lest and almost an equal percenlagc of high school students in 
the norming study would have passed. 
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Table 17 



Effects of Minimum Score Requirement of 40 on Rates of Passing 
Individual Tests: 1986 & 89 GED Examinees and 1987 Norming Sample 



Minimum Score: 




1986 




1989 




1987 


40 


Tested Passed 


Tested Passed 


Tested Passed 


Tesl 


N 


n 


N 


n 


N 


n ' 














\ ^0) 


Writing 


424 


400 


367 


340 


913 


831 














(yi.o) 


Soc. Studies 


449 


428 


415 


401 


913 


840 






(95.3) 




(96.6) 






Science 


450 


436 


411 


398 


913 


849 






(96.9) 




(%.8) 




(93.0) 


Reading 


460 


443 


437 


423 


913 


822 






(%.3) 




(%.8) 




(90.0) 


Mathematics 


423 


390 


370 


345 


913 


849 






(93.2) 




(93.2) 




(90.0) 



With a minimum score of 40 on each individual tesl, Table 17 illustrates that clo.sc to 95 percent of 
GED examinees would have passed the tests and over 90 percent of the students from the high school 
norming study would ha»'e piisscd. Compared to ihc minimum score of 35, there is greater differentiation 
within each group in terms of liic difnculiy level of the tests. For example, only 92.6 percent of those taking 
tests in 1989 passed the Writing test, compared to 96.8 percent who passed both the Science imd Reading 
tests. 
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Table 18 



Errects of Minimum Score Requirement of 45 on Rates of Passing 
Individual Tests: 1986 & 89 GED Examinees and 1987 Norming Sample 



1 Minimum Score: 
1 

H Test 


1986 
Tested Passed 
N n 


1989 
Tested Passed 
N n 
(%) 


1987 
Tested Passed 
N n 
(%) 


1 Writing 


424 317 
(74.8) 


367 256 
(69^) 


913 730 
(80.0) 


n Soc. Studies 


449 371 
(82.6) 


415 365 
(88.0) 


913 749 
(82.0) 


H Science 


450 384 
(85.3) 


411 365 
(89.0) 


913 767 
(84.0) 


D Reading 


460 386 
(83.9) 


437 375 
(85.8) 


913 721 
(79.0) 


Mathematics 


423 324 
(76.6) 


370 2% 
(80.0) 


913 749 
(82.0) 



With a minimum score of 45, (Tabic 18) the 1989 examinees would have out performed bolh the 198f) 
GED examinees and ihc 1987 norming sample on three of the five tests: Social Studies, Science, and 
Reading. The Norming sample would have outperformed both groups of GED examinees on ihc Writing and 
Mathematics tests. The largest percentage of examinees passed thr Science tests in all three groups and the 
lowest percentage failed the Writing tests for all three groups. 

Among the three groups, the greatest amount of variation in the percentage of those passing occurred 
among the 1989 examinees. Among this group there is a difference of 19.2 percentage points between the 
lowest rate of passing (69.8% for the Writing test) and the highest rate of passing, i.e., 89 percent for the 
Science test. This is compared to a variance of S percentage |)oints for the norming .sample and 1(1..^ Uir the 
1986 examinees. 
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Table 19 

Effects of Minimum Score Requirement of SO on Rates of Passing 
Individual Tests: 1986 & 89 GED Examinees and 1987 Norming Sample 



Minimum Score 
Test 


1986 
1 esiea rasseo 
N n 
(%) 


1989 
1 csteo rasseo 
N n 
(%) 


1987 
I estea rasseo 
N n 
(%) 


Writing 


424 214 

(50.5) 


367 148 
(403) 


913 584 
(64.0) 


Soc. Studies 


449 247 
(55.0) 


415 285 
(68.7) 


913 612 
(67.0) 


Science 


450 279 
(62.0) 


411 291 

(70.8) 


913 612 
(67.0) 


Reading 


460 275 
(59.8) 


437 298 
(68.2) 


913 548 
(60.0) 


Malhcmatics 


423 194 
(45.9) 


370 194 
(52.4) 


913 593 
(65.0) 



With a minimum score of 50 on each of the tests, the passing rate decreases significantly for alt 
examinees. The steepest decline would have occurred with the percentage (40.3%) of ihosc in 1989 who 
would pass the Writing lesi and ihc highest pasr.ing rate (70.8%) would have occurred for ihose passing ihu 
Scicncc icsis in 1989. The norming sample would have oui performed both groups of GED examinees on ihc 
Wriiing and Math tests. The 1989 examinees would have out performed the other two groups on ihe Social 
Studies, Science and Reading tests. The 1986 examinees would out perform the 1989 examinees on the 
Writing test but would not out perform either of the other two groups on any of the other tests. Therefore, 
in direct comparisons, the 1989 examinees compares favorably with the performance of the 1987 norming 
sample 

Again, the 1989 examinees had the greatest amount of variability with a spread of 30.5 percent 
bciwccn the lowest (40.3%) of passing the Writing test to the 70.8 percent passing the Science test. These 
figures contrast with the 7 perceniage points that separate those in the norming sample. Their most difllculi 
test was the Reading test in which 60 percent passed, and the least difficult were the Social Studies and 
Science tests in which 67 percent pas.sed. The 1986 examinees also varied greatly with 16.1 percentage pi»inis 
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separating the highest percent of passing (62% for the Science test) compared to 45.9 percent who would 
have passed the mathematics test. 



DISCUSSION 

The above data analysis provides evidence that the changes in score requirements significantly crfccicd 
those GED examinees who took the tests after the new requirements were operationalized. The data 
analyzed in this study point to several primary effects of the increased score requirements. 

No Effects on the Demographic and Academic Composition of Examinees 
There were no relevant significant changes in the demographic and academic characteristics of the 
examinees from 19S6 to 19S9. Although there were insufTici^nt data to analyze the effects of minorities in 
the samples, the significant increase in women and older learners were not found to he related to the 
academic performance of 1989 examinees in terms of their GED Status, Average Standard Scores, and Total 
Scores. 

Increased Academic Preparation and Performance 

The 1989 examinees significantly increased their academic preparation efforts in order to attain the 
higher minimum and average scores. They pursued a wider array of study options and while they studied for 
about the same number of hours per week as the 1986 examinees, they studied for significantly more weeks. 
The increased efforts apparently resulted in the statistically significant increase in academic pcrlbrniancc of 
the 1989 examinees compared to those in 1986. Normative comparisons via l-lcsls between the two groups 
regarding all scores on all five tests, original scores on all five tests, and retesi scores of examinees who 
failed iheir first tests consistently found that 1989 examinees significantly outperformed 1986 examinees on all 
tests, except the Writing Test. 

Increased Academic Failure 

Signifiaintly higher percentages of 1989 examinees failed to obtain minimum and average scores 
required for pa.ssing, even after one or more rctests. The number of those failing the tests increased by over 
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48 percent. The percentage of examinees taking retests did not change during the two years, but the failure 
rate for those taking retests in 1989 increased by 45.9 and 27.3 percent for examinees taking their first and 
second retests. 

The effects of the increased score requirements on the failure rate of 1989 examinees were illustraicd 
in Tabic 15 which analyzed the differential effects of different score requirements on the passing rates of 
1986 and 1989 GED examinees and the 1987 Norming Sample. This analysis showed that if the 1989 
examinees were held to the standards imposed In 1986, over 90 percent (an increase of 60 or 18.75 perccni) 
of ihem would have obtained passing scores. Conversely, if the 1989 requirements had been applied in 19S6 
(even with a weaker GED test), ihcn only 54.7 percent of them would have passed (a decrease of 139 
examinees; or 34.24 percent) of those who look all five tests in 1986. 

A Disincentive to Complete the Tests 

The percentage of 1989 examinees who did not complete all five tests also increased by over filly 
percent. Analysis of l-lest comparisons of icsi scores for 1986 and 1989 Noncomplelcrs, and eomparisdns of 
Noncomplciers from both years to their eounlerparls who cnmplcied ail five tests suggest thai 1989 
Noncomplelcrs may have discontinued their examinations for "academic* reasons. This notion is particularly 
apparent in the fact that the 1986 Noncomplciers* average score was above the 45 points needed for passing 
on four of the five tests, whereas the 1989 Noncomplelcrs averaged two points below the 50 required for 
passing. Also, 1986 Completers significantly outperformed Noncomplelcrs on three of the tests, but in 198*) 
Complciers signifieanily ouiperlormed Noncomplelcrs on all tests. These observations suggest the incrLMscd 
score requirements served as a strong disincentive to complete the tests for those examinees who fnilcd lo 
obtain the average score on one or more tests. 

Increased Pnrticipntion in Postsecondnry Edticnlion or Training 

Those examinees who look ihc icsls in 1989 were more likely to enroll in postseeonclary cducalion or 
iraining programs. When queried on the extent lo which the OED was "helpful", ihey were more likely th;it) 
I9S6 examinees to indicate it was helpful for the purpose of entering college. Perhaps the \W) examinees 
who met the higher standards imposed by the new score requirements had greater confidence in their 
abilities to perform in college and thereby perceived it as a more viable option than did ihe 1986 examinees. 



Reduced Economic Benefits 

As a group, the 1989 exart-vaees earned signiflcantly lower incomes and were signiHcantly more likely 
to be unemployed than those who took the tests in 1986. However, those 1989 examinees who passed the 
GED tests were signiHcantly more likely to be employed either full or part-time than those who failed. This 
f • observation suggests that economic benefits accrue more readily to examinees who obtain the GED ns 

} opposed to those who obtain higher scores on the tests^ but fail to obtain a diploma. 

: Increased Score Differentiation With Increases in Mininum Scores 

The analysis of the effectt of minimum score requirements on the rates of passing individual tests fo- 
the 1986 and 1989 GED examinees and the 1987 Norming Sample (Tables 16 - 19) found that with each 
increase in the minimum score requirement, there were correspondingly grcaier increases in ihe variances 
between the lowest and highest scores on the five tests among the GED examinees. Whereas the Norming 
Sample also experienced some variance, it was relatively small in comparison. For example, with a minimum 
score of 50, only 40.3 percent of the 1989 examinees would pass the Writing Skills test, but 70.8 percent 
would pass the Science itsv. a difference of 30.5 points. Whereas a similar analysis found that the 1986 
examinees had a variance of 16.5 points, the 1987 Norming Sample experienced a variance of only seven 
points. 

This observation could be interpreted in one of two ways. One interpretaiions is that as cohoris, GED 
examinees differ substantially from the 1987 Norming Sample. The older and more experienced GED 
examinees differ considerably within their cohorts in terms of the number of years that have elapsed since 
they last attended high school, the academic skills that they might have "lost" due to non usage, and the 
academic skills they could have increased due to continuous usage. However, high school seniors that move 

I through the curriculum as an age cohort, share similar academic experiences which are rcllccied in the 

cohesiveness of academic performances on the tests. This interpretation assumes the 1987 Norming Sample 
is representative of graduating seniors in Wisconsin and that the differences mted result Ircmi ihc "aduli life" 
experience as opposed to the "youth academic" experience. A second interpretation is that the minimum 
variances in the scores of the Norming Sample is evidence that ihc sample was bias and does not represent 

} ihe academic diversity thai actually exists among Wisconsin's graduating seniors. 
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CONCLUSIONS AND RECOMMENDATIONS 

This study suggests (ha( (he 1987 changes in GED score requirements significanUy effected (he 
academic preparation, performance, GED status, personal benePits, and social benefits of the 1989 GED 
examinees. Those high school noncompleters who desired the GED in 1989 apparently "^tried harder** by 
pursuing more study options, and by studying the same number of hours per week as 1986 examinees, but 
studying for significantly more weeks. For those who succeeded, increased participation in postsecondary 
education and training and opportunities for either full or part-time employment were salient benefits. 
However, for a disproportionately high percentage of them this effort and commitment was in vain. Their 
**last gamble on education*" resulted in failure and thereby exacted a high emotional toll in (he form uf cither 
a "disincentive** for them to continue to take the tests, or the experience of repeated failure from retest 
efforts. 

This significant failure rate appears to be related to the reduced economic benefits obscr\'cd for (he 
19S9 examinees as a group. Whereas, 1986 examinees with significantly more GED certificate holders, and 
the 1989 examinees who possessed the GED were more likely to be employed and to enjoy a significandy 
higher personal income, the 1989 examinees as a group tended to have significantly more unemployed and 
public assistance recipients. Il is apparent that the GED certificate does make a difference in the lives of 
recipients, and when it is denied to examinees, both the potential recipient and the society-at*large suffer. 

The mixed picture of positive and negative results of the changes in score requirements suggest that 
the experiment was not a total success, nor a total failure. The GED examinees did respond with increased 
academic efforts that did result in increased academic performance. Therefore, the following changes arc 
recommended: 

• 

1 The score requirements should be changed Trom a "minimum or 40 and an average 
or 50" to n "minimum or 40 and nn nvernge ot 45. This rcquircmcm wmikl miiiniain the 

minimum scores of (he prcscnl rc(|iiircmenis, (hereby demanding higher knovlcdgc of exiiminccs on 
all Icsls. However, il would lower Ihc required average scores, Iherehy permilling greater access to 
the GED. Given the proposed requirements, only 66 percent of hii'h school seniors nationally would 
pass compared lo 10 percent of the 1987 Norming Sample, 84.7 percent of 1986 examinees and 88.4 
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percent of 1989 examinees. Currently, ten other states utilize this requirement, including Maryland, 
California, New York, Washington^ and others. 

The results of the 1987 Norming Study should be disregarded as invalid and a new 
more representative study should be conducted. The minimum variances or the scores or 
the 1987 norming sample compared to the variances observed foi GED examinees again raise 
questions of the validity of the norming study. Also signiflcant questions remain in regard to its 
representativeness of either ethnic minorities in the state or of those that take the GED tests. 
Nationally minorities are disproportion;t2tely represented among the populations of GED icsi 
examinees, and on other nationally normed achievement tests, e.g., the ACT, SAT, etc., they have had 
significantly lower test scores than non minority examinees. Therefore, minorities in ihe suae of 
Wisconsin could be subjected to significantly inflated score requirements because they were 
underrepresented in the original norming sample. 

The .administrators or CCD test storage sites in the state or Wisconsin should 
adopt a common (uniform) set or data collection, storage and retrieval procedures. 
The data gathering and data analysis processes for this study were obstructed because of non- 
standardized data maintenance procedures. Requiring a common recordkeeping procedure could 
assure greater ease of access to GED test data by researchers and cvaluators in the ruuttc atui provide 
more reliable dam cm policy issues and quesiions, such as die GED performance of minoriiics. 
Currcnily, some test sites collcei data on the ethnicity of GED :ipplica;iLs and oihers do noi. 
The process used to establish score requirements for the GED tests should be 
evaluated . while the State Superintendent of Public Insiruciion has ihc auihoriiy lo csi:ihlish score 
requirements, the exact process used to make such an imporlanl decision which lilerally alTeeis the 
dreams and economic welfare of thousands of Wisconsin citizens annually and ihe role o( |)ublic 
discussion and debate on the issue remains shrouded in mystery. 

Firrthcr research should be conducted to address other signiricant questions and 
issues raised by this study . Among them are the following: 

BEST COPY AVAILA2L1 

45 

47 



a. 



To what extent do Wisconsin employers actually differentiate between high school 
noncompleters» GED recipients (either HSED or certificate holders)^ and high school diploma 
recipients? 



c. 



d. 



To what extent are employers concerned about GED examinees* ability to meet more rigorous 
score requirements? Are employers more interested in examinees' abilities to demonstrate 
their competence in ""passing** the tests? 

To what extent were minority GED examinees disproportionately affected by the changes in 
1987 GED score requirements? 

What are the long-term personal^ social^ and economic benefits of the GED compared \o the 
high school diploma, other alternative high school diplomas, and high sch(H)l noncomplctiiin? 

What are the key factors involved in maintaining the credibility of the (jED among employers 
and academicians at both t\v')-year and four-year colleges? 
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cKSMnMEIKEE 



Department of Administrative Leadersliip 

School of Education 



vm 




September 18, 1991 



Dear 

Several weeks ago I wrote to you seeking your opinion on the relevance of the GED in providing 
increased opportunities for employment and education. As of today I have not yet received your 
completed questionnaire. 

This research is being conducted for the State Board of Vocational Technical and Adult Education. 
The study examines tne effects of the 1987 increases in score requirements for passing the GED test in 
Wisconsin. These increases are believed to be responsible for a sharp decrease in the numbers of 
examinees who take and pass the GED tests. 

I am writing again because of the significance of each questionnaire to the usefulness of this study. 
Your name was drawn through a scientific sampling process in which everyone who took one or more 
of the GED tests in either 1986 or 1989 had an equal chance of being selected. This means that only 
about one of every 20 persons who took the tests are being asked to complete the cuiestlonnaire. In 
order for the results of this study to be truly representative of the opinions of all GED test examinees 
it is essential that each person in the sample return their questionnaire. As mentioned in my last letter, 
your responses will be treated confidentially. Survey results will be reported in groups of respon.ses 
which will in no way identify individuals. 

In the event that your questionnaire has been misplaced, a replacement is enclo.sed. Please return the 
completed questionnaire in the enclo.sed envelope by September 28, 1991. If you have any ijue.stions 
plea.se conta . me: (414) 229-5754 or at the address listed above. 

Your cooperation is greatly appreciated. 



If you have any complaints about your treatment as a participant in this study, please call or write: 
Dr. Berri Forman, IRB Coordinator 

Institutional Review Board for the Pioiection of Human Subjects 
Lapham B-20; University of Wisconsin - Milwaukee 



P.O. Box 413 
Milwaukee, WI 53201 



(414) 229-6016 



Although Dr. Forman will ask your name, all complaints are kept in confidence. 



I have received an explanation of the study and agree to participate. I understand that my 
participation in this study is strictly voluntary and that my responses are confidential. 



Name 



Date 



Sincerely, 



Larrv G. Martin (University of Wisconsin-Milwaukee) 
Enderis Hall • P'O Box 413 • Milwaukee. W! S3201 
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414 229-4740 
FAX 414 229-4666 
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WISCONSIN GED SURVEY 



Please take the time to complete this questionnaire. Your answers are totally confidential. No 
one will know your name. Please answer ALL questions COIMPLETELY. 

I. GED PARTICIPATION 

A. There are many reasons for not completing high school. Which reason below BEST describes 
your reason for leaving high school before completion. 

1) High School was not challenging enough. 

2) Became employed. 

3) Became very sick. 

4) Poor grades in classes. 

5) Entered the military. 

6) Personal reasons. 

7) Became pregnant/married. 

9) Disagreements with teachers and administrators. 

10) Other (Specify) 



B. Which of the following BEST describes your grades while you were in school? 

1) Mostly A (a numerical average of 90-100) 

2) About halfA and half B (85-89) 

3) Mostly B (80-84) 

4) About half Band half C (75-79) 

5) Mostly C (70-74) 

6) About half C and half D (60-64) 

7) Mostly below D (below 60) 



C. Were you encouraged by another person to become a GED participant? 



1) YES 

2) NO 



If YES, which of the following BEST describes the role of the person who encouraged your 
GED participation? 



1) 


Spouse 


6) 


Counselor 


2) 


Family _ 


7) 


Employer 


3) 


Friend(s) 


8) 


Social Services Worker 


4) 


High School Teacher (s) 


9) 


Judge 


5) 


Child (or Children) 


10) 


Other (Specify 



D. People take the GED tests for a number of reasons. Which of the following BEST describes 
your reason for taking the tests? (CHECK ONLY ONE) 

1) Obtaining a job. 

2) Keeping my job. 

. 3) Military entrance requirements. 

4) College entrance requirements. 

5) Technical School entrance requirements. 

6) Personal satisfaction. 

7) Other (Specify) 

E. There are a variety of study options to help GED participants complete the program. Did you 
use any of the options Usted in F. 1 - 5 below? 

1) YES (Please complete Part F below). 

2) NO (Please go to Part H below). 

F. Please RATE on a scale of 1-4 the study options whijh were most helpful to you. 
l=Not Helpful 2= Of Little Help 3=Somewhat Helpful 4=Most Helpful 

1) Had a personal tutor. 

2) Used GED video programs. 

3) Studied alone from a GED book. 

4) Took the official GED practice tests. 

5) Viewed GED instructional television. 



G. For those items you rated 3 or 4, please explain how the options were helpful. 



H. Did you study at a learning center or take classes to prepare for the GED test? 

1) YES (Please complete sections "I" and "J") 

. 2) NO (Please go to section "K") 



ERIC 



54 



I. Adults attending Adult Basic Education and GED classes sometimes face a variety of concerns. 
Please rate on a scale of 1-4 the extent to which the following statements describe your 
experiences in the adult basic education learning program. 

1 s 'Strongly Disagree 2 = Disagree 3 s Agree 4 = Strongly Agree 

1) I am satisfied with the extent of my knowledge development in the program. 

2) My educational experience has had a positive influence on my interest in ideas. 

3) The instructors I had contact with were genuinely superior teachers. 

4) The instructors I had contact with were generally interested in students. 

5) While in the learning program I developed close personal relationships with other 

students. 

6) The student friendships I developed in the learning program have been personally 

satisfying. 

7) My non-classroom discussions with instructors were a positive influence on my 

personal growth. 

8) My non-classroom discussions with instructors were a positive influence on my 

career goals. 



J. Please RATE on a scale of 1-4 how helpful the classes were in developing your academic skills. 
1 s Not Helpful 2 = Of Little Help 3 = Somewhat Helpful 4 > Very Helpful 
HOW HELPFUL WERE THE CLASSES FOR: 



1) Improving your reading skills? 

2) Improving your math skills? 

3) Improving your writing skills? 

4) Increasin g your knowledge of science? 

5) Increasing your knowledge of social studies? 

6) Improving your test-taking skills? 

7) Increasing your self-confidence? 

8) Helping you prepare for further education? 

9) Helping you improve job-related skills? 



K. About how many HOURS PER WEEK did you study for the GED ? CHECK ONE 
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1) 2 hours or less per week. 

2) 3-6 hours per week. 

3) 7-10 hours per week. 
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4) 11-15 hours per week. 

5) 16 or more hours per week. 



L. About how MANY WEEKS did it take you to prepare for the GED? CHECK ONE 

4 weeks or less. 
5-8 weeks. 
9-16 weeks. 
17-24 weeks. 
25 or more weeks. 

II. EMPLOYMENT INi ORMATION 

A. We are interest«)d in learning about your employment record. Are you now the MAIN wage 
earner in your household? 

YES 

NO 

B. When applying for a job, have you ever been told that a high school diploma or GED certificate 
were required for employment? 

YES (PLEASE ANSWER #1 BELOW) 

NO 

L About how many times has this happened to you? 

C. Which of the following BEST describes your CURRENT employment status? CHECK ONE 

a) I WORK FULL-TIME ( 35 or more hours per week). 

How many hours per week? 

« 

b) I WORK PART-TIME (less than 35 hours per week). 

How many hours per week? 

c) I AM UNEMPLOYED AND LOOKING FOR WORK. 

d) I AM UNEMPLOYED AND NOT LOOKING FOR WORK. 

1. Which of the above categories best describes your employment status BEFORE taking the 
GED? 

a) EMPLOYMENT STATUS BEFORE TAKING THE GED. 



1) 
2) 
3) 
4) 

5) 
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D. If you checked "a" or "b" in Part C. , please answer the following questions: 
1) What kind of work do you do? 



2) How long have you done this type of work?. 



3) How much do you earn per hour? 



E) CHECK which of the following income categories most closely estimates your personal income 
last year? (1990) CHECK ONE 



a) 


0 - $2, 999 


b) 


$3,000 


$4,999 


c) 


$5,000 -■ 


$7,999 


d) 


$8,000 -■ 


$10,999 


e) 


$11,000 


-- $13,999 


0 


$14,000 


- $16,999 


g) 


$17,000 


-- $19,999 


h) 


$20,000 


-- $22,999 


i) 


$23,000 


$25,999 


j) 


$26,000 


$28,999 


k) 


$29,000 


- $31,999 


1) 


Over $32,000 



1. Which of the above income categories best describes your income BEFORE taking the GED test? 
a) INCOME BEFORE TAKING THE GED. 

2. Place a CHECK by any statement which is true. CHECK ALL THAT APPLY 

a) I received pubHc assistance (AFDC, General Ass't.) BEFORE taking the GED. 

b) I received pubHc assistance DURING GED preparation.. 

c) I received pubHc assistance AFTER taking the GED. 

d) I CURRENTLY receive public assistance. 
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3. What is your PRIMARY source of financial support? CHECK ONE 



1) Personal Employment 

2) Public Assistance (AFDC, 
General Assistance) 

3) Spouse 

4) Parent(s) 

5) Sibling(s) (Sister t)r Brother) 



6) Social Security (and/or SSI) 

7) Unemployment Compensation 

8) Charitable Organization(s) 

9) Other Please Specify 



4. Please CHECK one statement that describes your income since taking the GED test: 

a) My income INCREASED since I took the GED. 

b) My income DECREASED since I took the GED. 

c) My income HAS NOT CHANGED since I took the GED. 

III. OTHER BENEFITS OF THE GED 

A. Have you now PASSED the GED tests? 

YES (PLEASE GO TO PART "B") 

NO (PLEASE GO TO PART "C") 

B. GED holders report a number of benefits from obtaining a GED certificate. 

1) Using the following scale of 1-4 please rate how the GED certificate has actually helped 
you. 

1 = Not Helpful 2 = Of Little Help 3 = Somewhat Helpful 4 = Very Helpful) 

a) Get a Job 

b) Keep a Job. 

c) Get a Promotion. 

d) Qualify For Entrance To A Two-Year College 

e) Qualify For Entrance To A Four- Year College. 

0 Other (Please Specify) 
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2) If you rated any of the above statements with a 3 or a 4, please DESCRIBE one of your 
( xperiences in which holding the GED was helpful. 



3) After obtaining a GED, did you actually enroll in an educational or training program? 

YES 

NO 

If YES, please check which type of program you are (or were) enrolled in: 

a) Two Year College 

b) Four CoUegeAJniversity 

c) TechnicalA^ocational College 

d) Trade School 

e) Apprenticeship/On-The-Job Training 

0 Other (Please Specify) 

4) Do you currently hold a GED certificate from Wisconsin? 

^YES (PLEASE GO TO SECTION IV BELOW) 

NO (PLEASE ANSWER a, b, c, BELOW) 

a) In what state did you receive the GED?__ 

b) In what year did you receive the GED?^ 

c) Did you take the GED tests in that state? 

YES 

NO (PLEASE ANSWER "d" BELOW) 



d) Did you request that your Wisconsin test scores be sent to that state? 

YES 

NO 



C. If you do not currently hold the GED, please explain briefly why. 



ERIC 



IV. DEMOGRAPHIC INFORMATION 



A. What is your marital status? 

1) MARRIED 

2) DIVORCED 

3) WIDOWED 

4) SEPARATED 

5) SINGLE 



B. What is your sex? 

DMALE 

2) FEMALE 



C. Please indicate your parents' highest level of educational attainment. (CHECK ONE FOR 
EACH PARENT) 

Mother Father 

1) Less than high school diploma. 

2) High school diploma. 

3) GED credentials. 

4) Some years of college. 

5) College degree. 

6) Don't know. 



D. Which of the followiiig best describes your racial or ethnic identification? 

1) Black (African American) 

2) Hispanic 

3) Native American (American Indian) 

4) White (Caucasian) 

5) Asian 

6) Other Specify 

ThAtiU v^ovi for complctiii5 ih\$ import^^nt $uryc\\. 



TU\$ mforfviM^OYi will hc]p UwmAkcrs. program 3ibm\y\\$trMor$ ^ky^t> tcAclicrs to 
]mprovc the G£D j>rosrAn\ m V "Ucofys'm, 
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